t 



K415/DBS/42055 



WHAT IS CLAIMED IS: 




£30 

D 

Q 
si 



!U5 

an 



20 



1 . A learning item sequencing system for optimizing a student's learning 
the system comprising: 

a computer including one or morfe memory portions; 
the memory portions comprising: 

a problem database containing a plurality of learning items, wherein a 
learning item is presented on each learning trial; 

a trial record database, fjor storing response data regarding the student's 
response to each learning item; 

software for implementing a trial loop, wherein the learning trials are 
presented to the student and response data are collected; and 

software for implementing a sequencing algorithm, wherein the algorithm 
sequences the learning items to be presented as a function of the response data collected 
from prior learning trials. 

2. The sequencing system of claim 1, wherein the response data collected for 
each learning trial includes the studejit's accuracy in answering the presented learning 
item and the student's response speed if the item was correctly answered. 

3. The sequencing system of claim 2, wherein each learning trial includes a 
priority score associated with the particular learning item. 



4. The sequencing system of claim 3, wherein the sequencing algorithm 
25 continuously updates the priority scire of each learning item based on the response data 
collected on the immediately preceding learning trial. 
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5. The sequencing system c f claim 4, wherein the number of trials since a 
particular learning item was last presented is a variable used by the sequencing algorithm 
in continuously updating the priority sc ore of each learning item. 



5 6. The sequencing system 

student's speed and accuracy in 



of claim 4, wherein the relative importance of the 
sequencing of learning items is parameter. 



7. The sequencing system 
trial loop includes a problem selector, 



^)f claim 5, wherein the software for implementing a. 
the problem selector selecting the learning item 



with the highest priority score for presentation to the student. 



8. The sequencing system 
learning items have the same high 
item for presentation at random from 
priority score. 



of claim 6, wherein when a subset of the plurality of 
priority score, the problem selector selects the learning 
the subset of learning items with the same high 



9. The sequencing system of claim 6, wherein the sequencing algorithm 
increases the priority score for each ir correctly answered learning item, wherein the 
probability of each incorrectly answered learning item being again selected by the 
problem selector increases, whereby the delay in learning item reappearance decreases. 



10. The sequencing system 
decreases the priority score for each cc 
probability of that learning item being 
whereby the delay in learning item 



qf claim 6, wherein the sequencing algorithm 
rrectly answered learning item, wherein the 
again selected by the problem selector decreases, 
reoccurrence increases. 



401976-1 



K415/DBS/42055 



11. The sequencing systerA of claim 10, wherein the sequencing algorithm 
decreases the priority score for each correctly answered learning item as a function of the 
student's response time in answering the question, wherein the delay in a particular 
learning item's reappearance increases as the student's response time to the particular 
learning item decreases. 
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12. The sequencing systein of claim 5, wherein the sequencing algorithm 
prevents the same learning item frcpi recurring for a predetermined number of trials. 

13. The sequencing system of claim 6, wherein each learning item may be 
assigned an initial priority score. 



14. The sequencing 
not modify the priority score 



systfem of claim 13, wherein the sequencing algorithm does 
of ea?h item until after its first presentation. 



15. The sequencing system of claim 14, wherein the initial order of appearance 
of all, or some, of the learning items may determined in advance by assigning all, or 
some, of the learning items initial priority scores in ascending or descending order. 

16. The sequencing system of claim 11, wherein the software for implementing 



the trial loop includes a learning itei 



retirement feature, wherein the learning items are 



retired from the problem database upon meeting a predetermined learning criterion. 



17. The sequencing systemlof claim 16, wherein the learning criterion for each 
25 particular learning item is a function of the student's accuracy in answering the learning 
item, and response speed for each correct answer, over a predetermined number of 
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repetitions of the learning item. 

18. The sequencing system of claim 17, wherein a session resumption feature 
stores an individual learner's data for leaping items, in terms of speed, accuracy, and 
problem retirement status for continuing the learning during another session at a later 
time. 



19. The sequencing system of claim 17, wherein the session resumption feature 
allows learning to continue at another time whence the retirement count of retired 
learning items is reduced, bringing them back for review and "re-retiring" if performance 
still meets learning criteria. 



20. The sequencing system 
allows previously retired learning i 
problem set if performance criteria do 
criteria. 



of claim 17, wherein the session resumption feature 
items brought back for review to rejoin the active 
not meet the previously established learning 



21. A learning item sequencing system for optimizing a student's learning, 
comprising: 

a computer including a central processing unit, a visual display device, at least one 
input device, and one or more memory portions; 

the memory portions comprising 

a problem database, wherein a plurality of learning items for presentation to 
the student is stored in the database, and further wherein each learning item has an 
associated priority score; ( 
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a trial record database, for storing a record containing response data 
regarding the student's response to each learning item, the response data collected for 
each learning item including the student's accuracy in answering each learning item and 
the student's response speed for each correctly answered learning item, the response data 
further including the number of trials since each particular learning item was last 
presented; 

software for implementing a trial loop, wherein the learning trials are 
presented to the student and the response d ita are collected, the software including a 
problem selector, wherein the problem selector selects the learning-item with the highest 
priority score for presentation to the student; and 

software for implementing a sequencing algorithm, wherein the algorithm 



continuously updates the priority scores for 



each learning item as a function of the 



response data collected from the prior learning trials, the sequencing algorithm increasing 
the priority score for each incorrectly answered learning-item and decreasing the priority 
score for each correctly answered learning item, wherein the probability of a particular 
learning item being again selected by the problem selector increases or decreases as a 
function of priority score. 



22. The sequencing system of claim El, wherein the sequencing algorithm 
20 continuously updates the priority score of eachllearning item based on the response data 
collected for the immediately proceeding learning trial. 



25 



23. The sequencing system of claim zl, wherein when a subset of the plurality 
of learning items have the same high priority sdore, the problem selector selects the 
learning item for presentation at random from tpe subset of learning items with the same 
high priority score. 
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24. The sequencing system of claim 2 1 , wherein the sequencing algorithm 
decreases the priority score for each correctly answered learning item as a function of the 
student's response time in answering the question, wherein the faster the student's 
response time the greater the decrease ii l priority score. 



25. The sequencing system c 
prevents the same learning item from 



f claim 21, wherein the sequencing algorithm 
incurring for a predetermined number of trials. 



26. The sequencing system o 
with each learning item may be assi 



gned 



27. The sequencing system o 
not modify the priority score of each 
particular learning item. 



claim 21, wherein the priority score associated 
an initial value. 



claim 26, wherein the sequencing algorithm does 
learning item until after the first presentation each 



28. The sequencing system ojf claim 26, wherein the initial order of appearance 
of all, or some, of the learning items may determined in advance by assigning all, or 
some, of the learning items initial prion ty scores in ascending or descending order. 

29. The sequencing system of claim 2 1 , wherein the software for implementing 
the trial loop includes a learning item retirement feature, wherein the learning items are 
retired from the problem database upon meeting a predetermined learning criterion. 



30. The sequencing system of c 
particular learning item is a function of th 



aim 21, wherein the learning criterion for each 
i student's accuracy in answering that learning 
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item, and response speed for each coVrect answer, over a predetermined number of 



repetitions of the learning item. 



\ 



building and maintaining 



learning items; 



31. A method for learning it^m sequencing for optimizing a student's learning 
speed, the method comprising: 

supplying a computer including one or more memory portions; 
the memory portions having software which performs the steps of: 



a problem database containing a plurality of 



building and maintaining 



trial record database, for storing response data 
regarding the student' s response to each! learning item; 

implementing a trial loop, Wherein the learning items are presented to the 
student and response data are collected; and 

implementing a sequencing! algorithm, wherein the algorithm sequences the 
learning items to be presented as a functidp of the response data collected from prior 
learning trials. 



32. A perceptual learning system for teaching students to recognize diagnostic 
structure from varying instances, the system comprising: 
20 a computer including one or more memory portions; 

the memory portions comprising: 

a problem database containing a plurality of learning items which are 
examples of different concepts, which, with respect to any one concept, includes a 
number of positive instances containing diagnostic structural elements and a number of 
25 negative instances which do not contain the dia gnostic structural elements of the concept; 
and ^ 
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software for implementing a trial loop, wherein the learning items are 



presented to the student in the form 



of short speeded classification trials. 



33. The perceptual learnir g system of claim 32, wherein the problem database 
includes learning trials in the form of structure discovery trials and structure mapping 
trials, the structure discovery trials requiring the student to recognize the diagnostic 
structure that determines a concept in a particular learning domain, distinguish positive 
and negative instances of the concept, and process the distinguishing information rapidly, 
and the structure mapping trials requiring the student to associate a structure in one 
representational format with the structure as it appears in one or more different 
representational formats. 

34. The perceptual learning system of claim 33, wherein the problem database 
contains numerous instances exemplifying a given concept to be learned, and the set of 
instances systematically varies in attributes and dimensions other than the diagnostic 
structure determining the concept. 



35. The perceptual learning system of claim 33, wherein for each concept to be 
learned, the problem database contains numerous instances not belonging to that concept, 
for use as negative instances in classification trials. 

36. The perceptual learning system of claim 33, wherein for each concept to be 
learned, the negative instances systematically vary in their attributes and dimensions and 
share with positive instances of the concept various attributes and dimensions other than 
the diagnostic structure features determining inclusion of the concept. 
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37. The perceptual learning system of claim 32, wherein the learning trials 
include a pattern classification response or a pattern comparison response. 



38. The perceptual learning system of claim 32, wherein the student is given 

tin 



feedback regarding his performance aft< 



39. The perceptual learning system 
database, for storing response data regarding 
and the concept of which it is an instance 
student's answer to each learning item, 4nd 
correctly answered learning item. 



each learning trial. 



of claim 32, further including a trial record 
the student's response to each learning item 
the response data including the accuracy of the 
the speed of the student's response to each 



40. The perceptual learning syi tern of claim 39, wherein the software for 
implementing the trial loop includes a retirement feature for concepts, wherein the 
individual concepts are retired from the problem database upon meeting a predetermined 
learning criterion for instances of that concept, wherein the learning criterion is a function 
of the student's accuracy in answering novel instances of that concept, and response 
speed for each correct answer, over a predetermined number of-presentations of instances 
of that concept. 



41. The perceptual learning system of claim 32, wherein the software for 
implementing a trial loop includes a problem selector, the problem selector selecting each 
learning item at random from the problem database. 



42. The perceptual learning system onclaim 41, wherein the problem selector, 
selects each learning item from the problem database according to the system of claim 21. 
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43. A perceptual learning system for teaching students to recognize diagnostic 
structure from varying instances, the s ystem comprising: 

a computer including a central processing unit, a visual display device, at least one 
input device, and one or more memory portions; 

the memory portions comprising: 

a problem database containing a plurality of learning items, wherein each learning 
item is in the form of a structure discovery trial or a structure mapping trial, the structure 
discovery trials requiring the student to recognize the diagnostic structure that determines 
a concept in a particular learning doi lain, distinguish positive and negative instances of 
the concept, and process the distinguishing information rapidly, and the structure mapping 

e a structure in one representational format with the 
different representational formats; 
ing a trial loop, wherein the learning trials are . 
presented to the student in the form of short speeded classification trials, wherein the 
classification trials include a pattern classification response or a pattern comparison 
response. 



trials requiring the student to associa 
structure as it appears in one or more 
software for implemen 



44. The perceptual learning system of claim 43, wherein the student is given 
20 feedback regarding his performance after each learning trial. 



25 



45. The perceptual learning system of claim 43, further including a trial record 
database, for storing response data regarding the student's response to each learning trial, 
the response data including the accuracy of the student's answer to each learning trial, 
and the speed of the student's response to each correctly answered learning trial. 
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46. The perceptual learning system of claim 43, wherein the software for 
implementing the trial loop includes a concept retirement feature, wherein concepts are 
retired from the problem database upon meeting a predetermined learning criterion, 
wherein the learning criterion is a function of the student's accuracy in answering the 
instances of that concept, and respons s speed for each correct answer, over a 
predetermined number of repetitions of each concept. 

47. The sequencing system of claim 46, wherein the contributions to concept 



retirement of learner speed, accuracy, 



ind number of presentations meeting speed and 



UO accuracy criteria, are parameter adjust* ble 



48. The perceptual learning system of claim 43, wherein the software for 
implementing a trial loop includes a problem selector, the problem selector selecting a 
learning item for each learning trial at r mdom from the problem database. 

49. The perceptual learning system of claim 43, wherein the problem selector, 
selects a learning item for each learning jtrial from the problem database according to the 
system of claim 17. 



20 50. A perceptual learning method for teaching students to recognize diagnostic 

structure from varying instances, comprising the steps of: 

supplying a computer including one or more memory portions; 
the memory portions having software which performs the steps of: 

building and maintaining a problem database containing a plurality of 
25 learning items which are examples of different concepts, which, with respect to any one 
concept, includes a number of positive instances containing diagnostic structural elements 
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and a number of negative instances which do not contain the diagnostic structural 
elements of the concept; and 

implementing a trial loop*, wherein the learning trials are presented to the 
student in the form of short speeded classification trials. 

51. An automated, time-base i hinting method for promoting learning and 
preventing student frustration, the method comprising the steps of: 

supplying a computer including a central processing unit, a visual display device, 
at least one input device, and one or more memory portions; 

the memory portions having software which performs the steps of: 

running a learning program; 

building and maintaining a database of hints 

presenting a student with a learning trial; 

selecting a hint if the student fails to respond in a predetermined period of time or 
fails to answer the learning item for that tqial correctly; and 
presenting the hint to the student. 



52. The hinting method of claim 5 1 , further including the step of providing 
feedback to the student after the student has responded to the hint. 

53. The hinting method of claim 5 A wherein the software selects hints from the 
group consisting of inverse operation hints, knpwn^problem hints, easy problem hints, and 
solved problem hints. 



54. The hinting method of claim 5 1 , wherein the software includes a hint 
selector that selects hints at random from the database of hints. 
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55. The hinting method of claim 5 1 ,1 wherein the software includes a hint 
selector that selects hints according to an algorithm. 



56. The hinting method of claim 53, 
selector that keeps track of previously used hinis 
different hint types and instances are used abou 



wherein the software includes a hint 
and hint categories to ensure that 
equally often. 



for providing hints in order promote 
em comprising: 

unit, a visual display device, at least one 



57. An automated, time-based system i 
learning and prevent student frustration, the sys 

a computer including a central processinj ; 
input device, and one or more memory portions; 

the memory portions comprising: 

software for running a learning program; 

a hint database containing a plurality of hihts; and 

software for implementing a hinting proceaure, wherein a student is presented with 
a learning trial and a hint is selected and presented to the student if the student fails to 
respond in a predetermined period of time or fails ^o answer the learning item for that trial 
correctly. 

58. The hinting system of claim 57, whereiV the hint procedure provides 
feedback to the student after the student has responded to the hint. 



59. The hinting system of claim 57, wherein pints are selected from the group 
25 consisting of inverse operation hints, known problem h|nts, easy problem hints, and 
solved problem hints. 
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60. The hinting system <^f claim 57, wherein the software includes a hint 

selector that selects hints at randoln from the database of hints. 

/ 



5 61: The hinting system 

selector that selects hints at 



of claim 57, wherein the hint procedure includes a hint 
randdm from the database of hints. 



62. The hinting system 
selector that keeps track of previ 
used about equally often. 



of claim 57, wherein the hint procedure includes a hint 
sly used hints to ensure that different hint types are 



o^ 



401976-1 



